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ABSTRACT 


An experiment was performed in which seventeen subjects 
responded to warning signals presented on displays simulat- 
ing integrated and conventional aircraft cockpit warning 
systems. Performance using the conventional system was 
superior in terms of both mean reaction time and number of 


errors committed. 
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A. BACKGROUND 

SebuieZzebece),.42n a study Of information transfer in 
the modern jet cockpit, discussed the historical develop- 
ment of cockpit display systems. He found that early 
aviators relied almost entirely on direct observation for 
information concerning the performance of their aircraft. 
Airspeed was reckoned by the sound and feel of the slip- 
stream; altitude by the size of objects on the ground; an 
engine’s performance by its sound, vibrations, and appear- 
ance. As aircraft performance increased there was a 
corresponding increase in the amount and precision of in- 
formation required by the pilot. Walters [1966] described 
the conventional instrument system which evolved to provide 
this information. The system consisted of a collection of 
discrete, dedicated instruments each of which sensed some 
Pi Steal Quantity and displayed it in the cockpit for the 
pilot's use. 

This system, with its refinements, has remained in use 
for many years during which aircraft have become increas- 
ingly complex and sophisticated. Bernberg and Gurman [1967] 
pointed out that the conventional system has two serious 
shortcomings: First, the area of the instrument panel is 
too small to contain dedicated instruments for all the 
information available in the complex, mocern aircraft pre- 


dicted for the 1980s. Second, even if some way were found 





POmeeoclay sath OL this information, it would be too much 
for the pilot to assimilate. 

Solution of these two problems was a point of major 
emphasis in subsequent cockpit display research from which 
the concept of an integrated cockpit emerged. Two examples 
of the development of this concept are the Digital Avionics 
Information System (DAIS) of the Air Force and the Navy's 
Advanced Integrated Modular Instrumentation System (AIMIS). 
Czuchry, et al. [1976] and Mulley [1975] discuss the concep- 
tual designs for these two systems. They find that the 
trend in cockpit display design is to eliminate as many 


conventional instruments as possible and substitute a few 


large integrated displays to four ends: (1) To improve 
information transfer in the cockpit; (2) to standardize 
cockpit layout; (3) to integrate non-standard avionics 


into standard display formats; and (4) to reduce cost. 
Figure 1 shows panel layout proposals for these two systems. 
These proposed systems contain the same classes of dis- 
plays, in essentially the same positions. The heads-up 
display (HUD) and vertical situation display (VSD) have 
azimuth and elevation as a basic coordinate system and con- 
tain pitch, roll, heading, altitude, airspeed, steering 
and weapon release information. The horizontal situation 
GiselavywtisDy as a plan-position indicator and presents 
geographic and navigation information such as heading, 
position, bearing, range, and cartography. Included on the 


panels is a new class of displays used to organize and 
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present engine and fuel data, armament data, and system 
monitoring information. These are called variously, multi- 
purpose displays (MPDs), master monitor displays (MMDs), 


or engine management displays (EMDs). 


Ee THE MASTER MONITOR DISPLAY CONCEPT 
Lowe, et al. [1974] describes the MMD as follows. 


"The Master Monitor Display (MMD) is a data processing 
and display system conceived as an integrated compon- 

ent of an Advanced Integrated Modular Information Sys- 
tem (AIMIS) and designed to provide an aircrew with an 
integrated presentation of warning and caution, func- 
tional status, mode advisory and auxiliary data ona 
Single display surface. The MMD will serve as a replace- 
ment for the multitude of lights, indicators, and gauges 
Wien ecUmrsently pEevide Chis status information to the 
crew." 


Mulley [1975] similarly explains: 


"The increasing number of aircraft avionics systems 
are resulting in numerous readouts and monitoring 
panels in scattered locations of the cockpit. At pres- 
ent, most of these are incandescent bulb-light abbreviated 


identifications. A proposed caution-advisory panel of 
this type for a new aircraft (F-14) called for more than 
fifty abbreviated identifications. The possibilities of 


error both in readout and responsive action are increas- 
ing. A master monitor panel would spell out the problem 
and list alternate actions. This would unburden the 
pilot from monitoring numerous displays, [and] remember- 
ing the meaning of abbreviations and the required 

ac CONS Ms 


"The Master Monitor Display will also provide the 
pilot with warning and caution, mode advisory, func- 
tional failure, and auxiliary information, together 
with recommended action in critical situations, ona 
single display. This display will reduce the need for 
the individual warning and advisory lights that are now 
scattered throughout the cockpit." 


Flat-panel matrix displays, because of their compact- 
ness, light weight and generally low power requirements, 


seem the most likely class of display to be used to 


10) 





implement the MMD concept. 


A typical proposal for such 


a display is shown in Figure 2. 
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MMD Display from Lowe [1974]. 





Pemtozmle266), In a discussion of some shortcomings 
of conventional warning systems states that in such systems 
the warning devices 


wo... are associated with, and usually located near, 
instruments which deal with the airframe and associated 
aircraft subsystems such as: fire, fuel, temperature 
and the like. A few warnings are associated with flight 
status, such as stall and overspeed. Some further con- 
fusion stems from the scattered location of such warn- 
ing devices all over the cockpit, so that a pilot must 
in some cases ‘work' to observe them." 


Figure 3 presents a typical example of such an arrange- 


emt taken £rom the cockpit of a P-3 aircraft. 





Figure 3. Instrument Panel Showing Warning Lights. 
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Unlike the MMD, which relies on alpha-numeric coding alone, 
this conventional design codes its information both alpha- 
numerically, through the labeling of lights, (shown above 
and to the right of the engine instruments in Fig. 3) and 
Beculalilvyeby the particular location of each labeled light. 
Since each light is uniquely associated with a particular 
Toreieng, dideltsS information is carried in its spatial code 
alone. With enough training a pilot could actually inter- 
pret these warning signals even with their labels removed. 
Although they are neither taught nor expected to identify 
warnings by light position alone, pilots regularly receive 
information through this code. When a pilot sees one or 
more lights illuminated above the gauges for a particular 
engine he knows that a problem exists with that engine even 
before he decodes the specific warnings indicated by the 
Ite ht or lights. 

A light's alpha-numeric label, while almost indispen- 
Sable in interpreting the individual lights is, in a sense, 
redundant and in many cases carries insufficient information 
by itself to adequately describe the warning. Knowing that 
an "Oil Hot" light is illuminated provides insufficient 
iatormatton to allow the pilot to take corrective action. 
He must also know over which bank of instruments the light 
is located. 

A symbolic display, of the type currently proposed for 
the MMD concept, relies on alpha-numeric coding alone. fin 


a human performance evaluation of matrix displays Scanlan 


ILS 









and Carel [1974] state that such symbolic displays 


ware those Ehat present symbolic information 
in an abstract coded form. Because symbolic displays 
generally have only a single brightness level for the 
generation of symbols, the transmission of the code 
relies on shape differences. The code can be common, 
aS in the case of alpha-numerics, or it may be a 
Special set of symbols that have meaning only ina 
particular context. In either case the primary 
requirements are rapid and accurate discrimination of 
characters." 

So Se URPOSE 

The question arises as to what effects this increased 
reliance on character identification and loss of spatial 
coding will have on the response time of subjects to a 
warning stimulus. 

In a study of the variables influencing operator 
information processing Olson [1963] exposed subjects to 
various levels of rate of information presentation, the 
number of channels through which it was presented, and the 
physical location and arrangement of the display media. 

As Figure 4 shows, the mean transformed reaction time 
increased with the number of media channels used to pres- 
ent a constant amount of information. Olson concluded that 
on the basis of his results it would be reasonable to expect 
that a subject would be able to handle a greater inflow of 
information if it could be channeled through relatively few 
media. He predicted a slower response time with a greater 


number of media coupled with lessened performance on 


other required tasks. 
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Figure 4. 
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Results from Olson [1963]. 
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While it is always dangerous to extrapolate beyond the 
data base, it might be reasonable to expect that a reduc- 
tion of the number of media to one would result in contin- 
ued improvement. If so, this would be an argument in 
favor of an MMD arrangement. 

The present experiment was designed to test the hypo- 
thesis that the combined effects of the loss of spatial 
coding and reduction of media channels will result in no 
change (decrement) in the performance of subjects respond- 
ing to an MMD type display as compared to their performance 
in response to a conventional type display. 

In this experiment subjects responded to warning signals 
presented on displays simulating conventional and inte- 
grated systems. A secondary task was performed simultane- 


ously to provide task loading. 
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Aj, SUBJECTS 

The subjects for the experiment were sixteen male 
military officer students and one male instructor from the 
Naval Postgraduate School. The sixteen officers ranged in 
age from twenty-six to thirty-three years, the instructor 
was forty-four years old. Subjects volunteered for the 


experiment. 


popeeo liu MULi AND APPARATUS 

Subjects were seated at a table in a sound reduced 
booth facing a translucent projection screen onto which 
thirty-five millimeter slides were back-projected. In this 
technique, suggested by Schultz [1968], the slides used were 
black-and-white and presented warning signals in schemes 
representative of conventional or integrated designs. An 
example of a slide used to simulate a warning in a conven- 
tional system is shown in Figure 5. This slide indicated a 
fire in engine number three. The names and unique locations 
of the sixteen warning signals presented are shown in Figure 6. 
The warnings at the top were grouped by engine. Those for 
engine number one were at the left, for engine number two in 
the center, and for engine number three at the right. The 
lower matrix displayed miscellaneous warnings. 

The engine warnings were placed in logical relative 


locations and groupings on the panel. This arrangement 1s 


ay 














Egupe Se Example of a4 
Conventional Warning Display. 
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Figure 6. Warning Labels with 
Positions on Conventional Display. 
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Speraetone Miyecesined sto belwellwcoded spatially. The 
miscellaneous warnings were intentionally placed at random 
with no logical order or grouping. This arrangement is 
operationally defined to be poorly coded spatially. 

Two examples of the slides used to simulate an inte- 
grated system are presented in Figure 7. In these slides 
the position of a particular warning was not unique since 
all warnings appeared in the same place on the screen. 

The resulting ambiguity in certain labels was resolved by 


extending the labels as shown in Table I. 


AUS U tay IE 
Extended Labels Used with the Integrated System 
CONVENTIONAL LABEL INTEGRATED EQUIVALENT 
13 JES8o: ENG FIRE NO. l 
HNG FIRE NO. 2 
ENG FIRE NO. 3 


Oe RSS PRES NOs a 


PRESS NO. 2 
BRiSs NO. 3 





Ort LeaM?P Cat TEMESNO: I 
Gah TEMESNO. 2 
Orting TEMEBNO 3 


NOTE: All other labels were the same in both systems. 


A panel of push buttons was situated on the table in 
maoOmeEoneene subj ect and slightly to his right. Sixteen 
buttons were arranged in a 4x 4 matrix and each was 
labeled to correspond to one of the sixteen warning sig- 
nals as shown in Figure 9. 

The nine buttons in the upper left portion of the 
panel were labeled to correspond spatially to the engine 
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Figure 7. Two Examples 
of Integrated Warnings. 
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Figure 8. Push Button Panel. 
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warnings in the conventional display. The remaining labels 
were assigned at random. 

A Yexas Instruments TI-59 calculator mounted on a 
PC-1LOOA printer was located on the table to the left of 
the button panel. In order to prevent inadvertent activa- 
tion of erroneous keys and to reduce distraction, the calcu- 
lator was covered so that only the numeric, decimal, 
ellangeSignag:/—), and run/stop (R/S) keys were exposed 
and the printer was covered to conceal its output. A loud- 
speaker was placed in the booth and used to present the sub- 
ject with taped instructions and aural clicks to be used 


as part of his secondary task. 


C.F OCE PURE 

Each subject was seated in the booth and given taped 
Mieerucetens fOr his first task, which was to respond to 
warnings presented on the screen in front of him. 
(Instructions to the subjects are contained in Appendix A.) 
He was told that when a warning appeared he was to press 
the labeled button corresponding to that warning as quickly 
and as accurately as he could. The timing was started 
when the projector shutter opened and stopped when the 
Subject pressed a button. He was shown examples of warn- 
ings in the conventional system and given a practice ses- 
sion in that system during which sixty-four slides were 
presented at four second intervals with each warning 


repeated four times at random. 


Due to external constraints placed on the length of the 
experiment it was decided to give no formal practice session 
using the integrated display. To compensate for this omis- 
sion, when a subject first saw the integrated display 
(during a scored run) the first slide presented was counted 
as a practice/familiarization trial and the reaction time 
For that slide was not used in subsequent analysis. This 
decision seemed reasonable since the same push buttons were 
used with both displays and because the integrated presen- 
tation was simple and straightforward and, once seen, was 
easily interpreted. 

The subject ae then given instructions for his second 
task to be performed simultaneously with the first. He was 
told that his task was to count and record on the calculator 
the number of clicks presented at intervals over the loud- 
speaker. He was told to record the clicks by pressing the 
key corresponding to the number of clicks, then pressing the 
R/S key. He was told to use his left hand for the aural 
task and his right hand for the visual task. The aural 
stimuli were present in groups of four, five, six, or seven 
clicks in a manner similar to that used by Garvey and Knowles 
[1954]. The subject was given a short practice session dur- 
ing which he responded to four groups of clicks. 

After the two practice sessions the subject was told 
that he would then begin a scored run during which he would 
perform both tasks simultaneously. He was instructed to do 


pemevell as he could on both tasks. The group to which the 
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subject was assigned determined whether he received the 
conventional or integrated system first. In either case 
during the scored runs the time between slide presentations 
was equally likely to be any integer number of seconds from 
eight to sixteen. Each of the sixteen warnings was repli- 
cated four times at random for a total of sixty-four 
presentations per run. 

During the scored runs the groups of aural clicks were 
presented at about seven second intervals. Ninty-nine 
groups were presented during each run. Each subject was 
exposed to the same sequence and timing of slides and 
elicks. 

The second scored run for each subject was identical 
to the first except that the type of system simulated was 
changed to integrated or conventional as appropriate. 

At the completion of the subject's second run he was 
asked to fill out a personal data questionnaire and 


requested not to discuss the experiment with other subjects. 


Dae OBS IGN 

Data from the experiment were analyzed according to a 
three-way factorial analysis of variance (ANOVA) [Winer, 
1962]. The three main factors were order of presentation 
(2 levels), display types (2 levels), and light groups 
(2 levels). Figure 9 is a errs model of the 
experiment. 

The dependent variable for the study was mean reaction 


time. The subjects were divided into two groups, one 


Zs 
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receiving the conventional display first and one receiv- 


ing the integrated first. 
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Pit Vpesurrs 
Table II is a summary of the results of the experiment. 
TAbLE ii 


Mean Response Times by Subjects 
Lights, and Runs 










CONVENTIONAL INTEGRATED 
SUBJECT ea Sie) (Second) (First) (Second) 
ey ae 1.98 ioe 
07 27 l 


PROP RP RRP 





cs 
@ 
OM wWOWMW+AINDUB WN E-E 


OF IRPRPRPRPRPRPREHEH 





S. Aes 2G 
iso: CONVENTIONAL INTEGRATED | CONVENTIONAL INTEGRATZD 
SUBJECT (Second) (First) (Second) (First) 
10 1.08 1.94 1.46 2.49 
Tak eG ie 1.54 ae 
12 1.28 i oS eas EG 
Le 1.40 Loh ine 2.24 
14 07 1.58 easy i.6e 
Ls eee TOG 1266 ake 
16 37 Dail! | 1.54 Dey. 
i als D3 1.98 DaSG 
Mean (hae il 13. 97 rcs. IE Pas 
aD. 0.19 De pA AG 


These results can be seen graphically in Figures 10 and 
ll. An analysis of variance (ANOVA) (Table III) indicated 
that there was a strong difference between displays and 
between light groups with a high degree of interaction 
between displays and light groups, between displays and 
order of presentation, and a significant interaction among 


lmagneeaguewes, displays, and order of presentation. 
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Analysis of Variance for the Experiment 





SOURCE Cee. See le eye 2 B 





Between Subjects 


Order (0) i 0.64 Oo 3.44 0-033 
BEEor 15 2278 Oo 


Viti Subjects 


Lights (L) 1 0 AG 99.64 0.000* 
jij <a @) al 0.00 OATaR6, eae Oe BS 
Bias or eS Ge lers: Oe (GE 
Displays (D) 1 Gees oe oa iy Os. Oreo ioe 
Dx O 1 0.90 0.90 blero Sy 0.000* 
BeEor 1S) 0.29 O02 
iby 5 2B, ip OOS 0.05 9.26 O 2008 * 
iby 9 Ba - <a @) iE O207/ O07 eo 35 O70 UI 
ldpgngioue LS 02.03 Oe Oak 


feomgniricant at a = 0.01 


TOTAL 5) i OES 0 


NOTE: Values are rounded to two decimal places for 
aol lLatlon. 
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When considering the difference between displays it 
is convenient to consider the engine warnings and the 
miscellaneous warning separately. 

In the case of the engine warnings it can be seen in 
Figure 10 that the subjects responded faster to the conven- 
tional display than to the integrated one regardless of 
the order of presentation. This result stems from the fact 
that in the conventional system the positions of the engine 
warnings and their associated push buttons corresponded 
spatially. As a result the subject, after a few minutes of 
Mace lee, Could press the correct button without actually 
having to read the warning label. This importance of 
compatability of display and control with respect to rela- 
tive spatial location is consistent with the findings of 
Garvey and Knowles [1954], Chapanis and Lockhead [1965], 
and Poock [1969]. This experimenter feels that this situ- 
ation accurately simulates a pilot's response to warnings 
that are well known to him and well coded spatially in the 
Gockpit.. (It should be noted here that the distinction 
made between "engine" and "miscellaneous" warnings 1s one 
of degree of spatial coding. The words "engine" and 
Tiecellaneous' are used only to distinguish those laghts 
that were well coded from those that were poorly coded in 
the conventional display. The fact that the well coded 


warnings were associated with the engines has no Significance 


@ 





per se.) With the integrated display the subject had to 
first read the display and then respond to it, thus slowing 
his response time as shown. Heimstra and Ellingstad [1972] 
Pieter scussion Of control coding also noted this extra 
time requirement to read labels and cite it as one of the 
disadvantages of using alpha-numeric coding. 

In the case of the miscellaneous warnings the conven- 
tional display also usually produced faster mean reaction 
times. However, an examination of Figure ll reveals that 
when a subject received the integrated system second, his 
performance on the two displays was nearly equivalent. 

Only two of these nine subjects reacted to the conventional 
display significantly faster (a = 0.05). This result seems 
Een indreate that the subjects were still learning through- 
out the experiment and that, with continued practice, the 
integrated display might prove to be as effective as the 
conventional. While this might be true in an experimental 
sense, in an actual flight setting the appearance of a 
warning signal is a relatively rare occurrence. This 
experimenter feels that measurements taken early in the 
subject's learning period more accurately approximate his 
performance in an actual flight situation. 

Learning curves for the seventeen subjects were plotted 
by light groups and displays. Examination of the curves 
revealed only a very slight learning phenomenon. These 
results may, however, have been obscured by the interac- 


tion between the primary and secondary tasks. 
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The ANOVA also revealed a significant difference in 
mean reaction times between the engine and miscellaneous 
warnings. Reference to Figures 10 and 11 shows that the 
engine lights were reacted to faster than the miscellaneous 
ihitjditcein all cases. This result seems at first to be 
inconsistent. One would expect that there would be a dif- 
ference using the conventional display since the push 
buttons were deliberately labeled to enable the subject 
to respond to the engine warnings without having to read 
them. But one would not expect to see such a difference 
using an integrated display in which all the warnings had 
to first be read then reacted to. The observed difference 
might be explained by the fact that the spatial coding of 
the engine push buttons shortened the subject's search time 
in both cases by enabling him to recode the alpha-numeric 
information on the button panel into a more economic 
Spatial code in a manner described by Welford [1968] in his 
chapter on economy of decision. It is noted, however, that 
the difference between the engine and miscellaneous warn- 
ings was, as expected, more pronounced with the conventional 
system. 

The interaction between displays and order of presenta- 
tion was also shown to be significant. The data indicate 
that the integrated display was more sensitive to the order 
of presentation than was the conventional. Mean response 
times with the conventional display differed very little 


from subjects who received that display first to those who 
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received it second. However, those receiving the inte- 
grated display second reacted significantly faster than 
Ehose who received it first. This interaction might be 
explained as follows. The practice run for all subjects 

was made using the conventional display. The control/dis- 
play (C/D) correspondence for the engine lights was learned 
rapidly and the subject could quickly respond to these 
lights without having to read them. When his first scored 
run was also made with the conventional system this knowl- 
edge carried over into that run and the subject's overall 
response time was lowered. But while reacting almost 
automatically using the spatial C/D relationships he was 
also learning the button locations in an absolute sense. 
This knowledge of absolute button locations then carried 
over into the second scored run (on the integrated system) 
reducing his search time for that run. However, when the 
first scored run was made using the integrated system the 
absolute locations of the buttons was still uncertain and, 
since no spatial cues were given by the display, the subject 
lost the luxury of responding automatically while learning 
these locations. Instead, his reaction time was, in part, 
dependent on this knowledge and slowed accordingly. On his 
second scored run (with the conventional system) the spatial 
C/D relationships again quickly enabled him to respond 
automatically with reaction times comparable to those by 


subjects who had the conventional display first. 
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Another significant interaction was that between lights 
and displays. It can be accounted for DY MObservVingwenat 
the miscellaneous lights were effected less by different 
displays than were the engine lights. 

The significant three-way interaction among lights, 
displays, and order of presentation is indicative of the 
fact that the performance on conventional and integrated 
displays was nearly equivalent for miscellaneous lights by 
subjects who received the conventional display first, while 
in all other cases the performance was significantly 
different. 

An examination of the errors made while responding to 
these systems is also of interest. There were no errors of 
omission, every warning was responded to in the time avail- 
able. Using the conventional system there were only five 
errors of commission and no subject made more than one. 
Using the integrated system, however, four subjects made 
one error, four made two errors, three made three errors, 
and one made five errors for a total of twenty-six (over 
five times the number made using the conventional system). 

Performance on the secondary task seems to have been 
independent of both error rate and reaction time for the 
primary task and fairly consistent across displays and 
subjects. Eighty-three secondary task errors were made on 
runs with the conventional system and seventy-two with the 
integrated. Eight subjects' secondary performance was 
better with the integrated display and nine did better 


with the caqnventional. 





It seems, from the results of this experiment, that 
the hypothesized decrease in reaction time due to media 
reduction observed by Olson [1963] either did not occur 
or was of less magnitude than the increase in reaction 


mime due to the loss of spatial coding. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


It is recognized that an integrated warning system 
offers many advantages over a conventional one and that 
such a system will inevitably be placed in the cockpits of 
Pietro miigiiter and attack aircraft. Its versatility, light 
weight, and compactness make it an attractive choice ina 
setting in which these factors are often critical. 

It should be noted, however, that such a system is not 
without its disadvantages. This experiment has shown that 
mean reaction time to warnings presented on the integrated 
display was slower than that to those presented on the con- 
ventional display. Whether or not this statistically sig- 
nificant difference is significant in an operational sense 
Nucteoemaccemmined in light of other factors such as the 
Smieicalbey Of —ENne warning involved and its sensitivity to 
reaction delays. 

Furtner, it was observed that the number of errors 
committed with the integrated display was much greater 
than with the conventional, an unhypothesized result which 
warrants further investigation. 

The author believes that further studies of possible 
shortcomings of an integrated display should be undertaken 
before such a system is installed in larger aircraft in 
which panel space and weight requirements are not as criti- 
cal and for whicn a conventional system remains a viable 


alternative. 
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APPENDIX A 
TAPED ENS TRUCTIONS TO SUBJECTS 


During this experiment you will be asked to perform 
two simultaneous tasks. The first consists of responding 
to slides presented on the screen in front of you. When a 
slide appears, you should press the appropriate button on 
the panel in front of you as quickly and as accurately as 
possible. You will be scored on both speed and accuracy. 

This is an example of one type of slide. It simulates 
a type of warning system used in some aircraft. The warn- 
ings for engine number one are located at the left; for 
engine number two, in the center; and for engine number 
three, at the right. The lower panel displays miscellan- 
eous warnings. 

Take a few minutes to study the pattern and become 
familiar with where the individual warnings are located, 
both on the slide and on the button panel. [Two minutes 
given for study.] 

PESoMeoreENoractice session will follow. Please respond 
to the slide by pressing the approrpriate button as quickly 
and as accurately as you can. [Practice session follows.] 

Your simultaneous task will be to count and record the 
number of clicks in a series of clicks presented to you on 
this recorder. After each series of clicks, key the total 
Mimpemeorecilicks that you counted into the calculator 


located to your left. Do this by first keying in the 
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total, then pressing the run/stop key in the lower left- 
Mend) COrnenh OL Ene Keyooard. §it 1S important that you 
respond to each series whether or not you are sure of 

your answer. If you are not sure, you may respond by 

Simply pressing the run/stop key alone, without keying in 

an answer. It is important that you respond to every series 
and that you press the run/stop key only once per series. 
You may not change an answer once it has been keyed in. 

If you think the answer that you have keyed is wrong, press 
the run/stop key anyway and go on to the next series. 

A short practice session will follow, please respond 
as directed. [Practice session on aural task follows. ] 

A scored run now follows, use your left hand to respond 
to the clicks and your right hand to press the warning 
Eicheotetons. 6 You should try co do as well as you can on 
both tasks. 

Sineomeollowing adadw@tyonal instructions were given for 
runs using the integrated system. ] 

On this run the slides you will see are different 
from the ones you saw on the practice run. Their meaning 
will be obvious and you should respond to them the same 


way you did to the others. 


38 





IO 


ae ae 


ii Siwo! REVERENCE S 


Bernberg, R. E. and Gurman, B., "The Integrated 


Cockpit," Space/Aeronautics, p. 68-74, 
November 1967. 


Cieednis, Ans dneeweckhead, G. R., "A Test of the 
Effectiveness of Sensor Lines Showing Linkages 
Between Displays and Controls," Human Factors, 
Von. 2ig=—2307 gune 1965. 


Czuchry, A. J. and others, Mid-1980s Digital Avionics 
Information System Conceptual Design Configuration, 
Air Force Human Resources Laboratory Report 
Awe wR=7 6-59, July 1976. 


Garvey, W. D. and Knowles, W. B., "Response Time 
Patterns Associated with Various Display-Control 
Relationships," Journal of Experimental Psychology, 
Wrmeee >. 315-322, April 1954, 


Heimstra, N. W. and Ellingstad, V. S., Human Behavior, 
A Systems Approach, p. 457, Brooks/Cole, 1972. 


Lowe, R. W. and others, Advanced Technical Evaluation 


SteaeMascer Monitor Display, Hughes Aircraft 
Company Report HAC-P74-457, October 1974. 


Mulley, W. G., Program Plans for AIMIS (Advanced 
Integrated Modular Instrumentation System), Naval 
Air Development Center Report NADC-75354--50, 

31 December 1975. 


Olson, P. L., "Variables Influencing Operator Informa- 
Eton Processing,’ Human Factors, V. 5, p. 109-116, 
Exetel 1963. 


Pooek, G. K., "Color Coding in Compatible and Non- 
compatible Display-Control Arrangements," Journal 
emoroo lied Psychology, V. 53, p. 301-303, 

Puguiste 1969. 


Seaman, bb. A. and Carel, W. b., Human Performance 
Evaluation of Matrix Displays: Literature and 
Technology Review, Hughes Aircraft Company Report 
HAC P75-468, D1755, June 1976. 


Schultz, W. C., Problems of Information Transfer in 


the Modern Jet Cockpit, Cornell Aeronautical Labora- 
tory Report CAL-IH-2235-B, December 1968. 


he, 





12. Walters, D. J., "Cockpit Displays," AGARD Conference 
Proceedings No. 17, Paris, France, North Atlantic 
Macodey OLGamaaelem, tart 2c, Dp. 959-977, 

September 1976. 


Peet eond, A. eerundamentals of Skill, p. 179-130, 
Methuen, 1968. 


Pe inot, Sade, seatistical Principals in Experimental 
Design, McGraw-Hill, 1962. 


40 





twine DiSsGRasuLiONn List 


Defense Documentation Center 
Cameron Station 
Alexandria, Virginia 22314 


mipiary, Code 0142 
Naval Postgraduate School 
Monterey, California 93940 


Department Chairman 

Department of Operations Research 
Naval Postgraduate School 
Monterey, California 93940 


Asst. Professor D. E. Neil, Code 55Ni 
Naval Postgraduate School 
Monterey, California 93940 


CDR L. E. Waldeison, Code 55Wd 
Naval Postgraduate School 
Monterey, California 93940 


LCDR Joseph D. Mazza, USN 
R.D. #2 Box 104K 

Summit Drive 

Lake George, New York 12845 


41 


No. 


Copies 














Thesis 
M39°¢ 
apa’ 


Mazza * 
A comparison of in- 








